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(57) A game system that allows a player to manip- 
ulate a real interface device In a real space and have a 
representation of the real interface device (i.e., a virtual 
interface device) be displayed in a virtual space is dis- 
closed. The position of the real interface device in the 
real space is detected by a position detector and con- 
verted Into spatial coordinates by a three-dimensional 
input conversion means at predetermined time Inter- 
vals. When a player moves the real interface device, a 
virtual interface device is displayed within the virtual 
space and moves identically with the real interface de- 
vice. The virtual interface device is determined to have 
struck an object in the virtual space (e.g., an enemy) 
when the coordinates of at least a portion of the object 
in the virtual space are the same as, or within a prede- 
termined range of, the coordinates of the virtual inter- 
face device. With such a game system, players in real 
space can freely control objects within the game space 
and thereby fee) as though they themselves are in the 
game space. 
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Description 

[0001] This invention generally relates to video 
games in which an object moves in a video game space 
in response to commands from a player. 
[0002] Video games in which an object moves in a vid- 
eo game space in response to commands from a player 
are well know in the prior art. Some examples of these 
include driving/piloting games in which a player drives 
a car or pilots an airplane, battle games in which a player 
battles an enemy by operating battle machines or ani- 
mated characters that represent the player himself, and 
sports games in which a player plays a sport by operat- 
ing an animated character that represent the player him- 
self. 

[0003] With aircraft piloting video games, for example, 
a player controls an aircraft by means of up/down and 
right/left arrow buttons or a controller modeled after an 
aircraft control stick. Likewise, with battle games a play- 
er cames out attacks on an enemy by controlling the 
movement of a battle machine with the controller or ar- 
row buttons, or with instruction buttons that direct the 
use of weapons. 

[0004] With sports video games, video game devices 
have been offered in which a player plays a soccer game 
by controlling the movements of an athlete character 
with arrow buttons or a variety of instruction buttons. For 
example, a boxing game has been offered in which a 
player stands in a predetermined position In real space 
and fits on gloves connected to the game device. The 
player attacks an opponent displayed on a screen in 
front of him by thrusting the gloves toward the screen. 
To defend against attacks from the opponent, the player 
dodges to the left/right In the predetermined position In 
real space. 

[0005] In the driving/piloting games, battle games and 
soccer games described above, a player presses pre- 
detennined buttons or manipulates a bar to control ob- 
jects within the game space. However, controlling ob- 
jects by manipulating buttons or bars tends not to be 
very realistic. To begin with, commands that instruct 
which object within the game space Is to move, and in 
what direction, are assigned to the buttons and bars In 
advance. Thus, movement of the objects by means of 
the buttons and bars is limited by the combinations of 
action patterns preset in the game. 
[0006] One aspect of the boxing game described 
above that Increases the enjoyment thereof is that the 
player's own punching and evading movements have an 
Impact on how the game unfolds. However, this does 
not mean that the gloves that a player is wearing are 
displayed as objects within the game space, or that play- 
er movements to avoid attacks from the opponent are 
displayed as objects within the game space. Because 
of this, a player Is not able to visually or physically sense 
his punch striking the opponent or having eluded the op- 
ponent's punch, and thus does not get enough of a true 
sense of reality In the boxing game. 



[0007] In other words, a game device has yet to be 
offered in which players in real space can freely control 
objects within the game space and thereby feel as 
though they themselves are in the game space. 
5 [0008] It Is therefore desirable to provide a technology 
to allow a player within a real space to play a video game 
by freely controlling objects within the video game 
space. 

[0009] According to one aspect of the present inven- 
10 tlon, there is provided a video game device in which a 
real interface device operated by a player within a real 
space is represented by a virtual interface device within 
a virtual space and displayed on a screen. The game 
devkse In this embodiment Includes: 

position detecting means for detecting the position 
of the real Interface device within the real space; 
conversion means for converting the detected real 
position into a position within the virtual space, and 
based on the virtual position, detemining the posi- 
tion in which the virtual interface device Is displayed 
on the screen; and 

operating means for displaying movements of the 
virtual interface device on the screen, which causes 
the real position to be detected by the position de- 
tecting means, and the display position of the virtual 
interface device to be determined by the conversion 
means, at predetennlned time intervals A T^. 

[001 0] Examples of a virtual interface device include, 
but are not limited to, a bat. a racket, a golf club, a shield, 
or an animated character representing the player him- 
self. By making the virtual Interface device and the real 
interface device similar in form, a video game will have 
a better sense of realism. For example, if the virtual in- 
terface device is a sword, the real interface device Is 
preferably shaped like a sword, and if the virtual inter- 
face device Is shaped like a shield, then the real inter- 
face device is preferably shaped like a shield. For the 
same reason, the virtual interface device and the real 
interface device are preferably made into similar fomis 
for sports video games, in which the virtual interface de- 
vice is a bat, racket, golf club, or other type of sports 
equipment. If the virtual interface device is an animated 
character, the real interface device could be an object 
(s) that the player puts on his or her person, e.g., a hat, 
a pair of gloves, a belt, goggles, or footwear. 
[001 1 ] The position detecting means includes, for ex- 
ample, light-emitting elements provided in the real inter- 
face device, and at least one pair of CCD cameras fixed 
in predetennlned locations. The detected real position 
of the real interface device Is converted into a position 
wothin the virtual space In which the game Is carried out. 
The position in which the virtual interface device is dis- 
played on the screen is calculated from the virtual posi- 
tion, and the virtual interface device is then displayed. 
The position of the real interface device Is detected, and 
the display position of the virtual interface device is cal- 
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culated, at a fixed interval of, for example, 1 6 msec. The 
movement of the real interface device manipulated by 
a player is accordingly displayed on the screen as the 
movement of the virtual interface device. For example, 
if the player were to swing a sword, the sword displayed s 
on the screen would be swung in an identical manner. 
[001 2] It should be noted that there may be a plurality 
of real interface devices. For example, a fighting game 
in which a player uses a sword and shield to battle an 
enemy is made possible In the present invention, as well 
as a situation in which a group of players jointly fight 
enemies within the virtual game space. 
[001 3] Preferably, In a video game device embodying 
the present invention, the position detecting means fur- 
ther specif ies three dimensional coordinates for the real 
interface device within the real space, and the conver- 
sion means further converts the real space coordinates 
into three dimensional coordinates within the virtual 
space, and based on the virtual space coordinates, de- 
temninesthepositioninwhichthevlrtual interface device 
is displayed on the screen. 

[0014] The position of the real interface device is de- 
scribed with three dimensional coordinates from the po- 
sition detecting means. For example, the position and 
direction of the real interface device may be specified 
by detecting two predetermined real space coordinates. 
The position of a surface of the real interface device may 
be specified by detecting three predetemriined real 
space coordinates. For example, when the virtual inter- 
face device is a rod-shaped object such as a sword or 
bat, the position of the real interface device may be de- 
tected at two points. In cases in which the virtual inter- 
face device has a planar fomn such as a racket or shield, 
the position of the real interface device may be detected 
at three points. 

[0015] It should be noted that the following method 
may also be used to detect the position of the real inter- 
face device. The real space and the virtual space are 
respectively divided Into real sub-spaces and virtual 
sub-spaces of predetermined size, and information that 
identifies each sub-space is then established. The po- 
sition of the real interface device is specified with real 
space identifying infonnatlon, and the real space iden- 
tifying infomnation is then converted Into virtual space 
identifying infomnation. 

[0016] Preferably, in a video game device embodying 
the present invention, the position detecting means de- 
tects at least two points on the real interface device, and 
further Includes: 

Intersection display control means that calculates 
the position in which a straight line that extends be- 
tween the points intersects with the display, and 
then displays a marker on the screen that indicates 
the intersection; and selection accepting means for 
detemiining whether or not the intersection and a 
display object being displayed on the screen over- 
lap, and if so, accepting the selection of the display 



object. 

[0017] Take, for example, a situation in which a diffi- 
culty level selection menu is displayed. When a prede- 
temriined button is pressed while the real interface de- 
vice is pointing at any one of the displayed difficulty lev- 
els, the desired difficulty level will be selected. Likewise, 
when, for example, a predetermined button is pressed 
while the real Interface device is pointing at a displayed 
enemy, a preset assault will be executed, e.g., a bullet 
will be fired, a knife will be thrown, or the like. 
[001 8] Preferably, in a video game device embodying 
the present invention, the game devtee further includes: 

first trajectory storing means for storing the virtual 
position of the virtual interface device taken at pre- 
detemnined time intervals A T2 (A T2 > A T^); and 
hit determining means for detemiining the trajectory 
and speed of the virtual interface device based on 
the virtual position stored in the first trajectory stor- 
ing means, and based on the trajectory and speed 
thereof, determining whether or not an object within 
the virtual space and the virtual interface device 
have struck each other, and specifying the object if 
the two have struck. 

[0019] The trajectory storing means stores virtual 
space coordinates measured within, for example, the 
past 1 60 msec. The movement of the virtual Interface 
device of the present invention differs from movement 
directed through a joystick or buttons on a controller in 
that the direction and speed thereof are unspecified. 
Therefore, a change in the position of the virtual inter- 
face device within a fixed period of time is stored in 
memory, and the trajectory and speed of the virtual in- 
terface device are calculated from this change. Whether 
or not an object and the virtual interface device within 
the virtual space have struck each other is detennined 
based upon the calculated trajectory and speed. Fur- 
thermore, since the objects are of a variety of 
types — natural objects such as enemies, trees, bamboo 
and the like, and man-made objects such as houses, 
walls and the like — the hit determination means speci- 
fies what the virtual interface device has struck. 
[0020] Preferably, in a video game device embodying 
the present invention, the game device further includes: 

second trajectory storing means for storing the vir- 
tual position of the virtual interface device taken at 
predetermined time intervals A T3 (A T3 > A T^); 
command storing means for correlating and storing 
predetermined trajectory patterns to betaken by the 
virtual Interface device with commands that execute 
the same; and 

command execution means for calculating the tra- 
jectory of the virtual interface device based upon the 
virtual positions stored in the second trajectory stor- 
ing means, determining whether or not the calculat- 



es 



20 



25 



30 



35 



40 



45 



50 



3 



5 



EP 1 249 260 A2 



6 



ed trajectory matches any of the predetermined tra- 
jectory patterns, and if so, executing the command 
that correlates with the matching trajectory pattern. 

[0021] When the movement of the virtual interfacede- 
vice within the virtual space corresponds with a prede- 
temiined pattern, e.g., a "cross move", a command is 
executed In response to this pattern, e.g., "l<nock down 
all enemies within 10 m inside the virtual space". 
[0022] Preferably, in a video game device embodying 
the present invention, the game device further Includes: 

third trajectory storing means for storing the real po- 
sition detected at a predetemnined time interval A 
T4(AT4>ATi), 

command storing means for correlating and storing 
predetermined trajectory patterns taken by the real 
Interface device with commands that execute the 
same; and 

command execution means for calculating the tra- 
jectory of the real interface device based upon the 
real position stored in the third trajectory storing 
means, detemilning whether or not the calculated 
trajectory matches any of the predetennined trajec- 
tory patterns, and if so, executing the command that 
correlates with the matching trajectory pattern. 

[0023] If the movement of the real interface device 

within the real space con-esponds with a predetermined 
pattern, e.g., a "cross move", a command Is executed 
that responds to the pattern, e.g., "knock down all op- 
ponents within 10 m Inside the virtual space". 
[0024] Preferably, in a video game device embodying 
the present invention, the game device further Includes: 

correction means for detecting any difference be- 
tween the player's height and a predetermined 
standard height from the position of the real inter- 
face device within the real space, and based on the 
detected difference, correcting the position of the 
real Interface device within the virtual space. 

[0025] Take, for example, the situation In which a 
standard height is set to 180 cm. If the player is a child 
90 cm in height, the real interface device that the player 
manipulates would be displayed low on the screen, and 
thus possibly spoiling the fun of the game for that player. 
Accordingly, differences in the position and movement 
of the real Interface device created by differences in the 
height of the player are con-ected such that the virtual 
Interface device is displayed identically 
[0026] Preferably, In a video game device embodying 
the present Invention, the position detecting means fur- 
ther includes: 

light emitting means installed in the real interface 
device; 

at least a pair of light detecting means for detecting 



light from the light emitting means; 
and measuring means for measuring the position of 
the light emitting means based on the detected light 
and outputting the measurement results to the con- 
5 version means. 

[0027] For instance, the light detecting means ena- 
bles coordinates to be detected on each of the x, y and 
2 axes within a predetermined real space coordinate 

10 system. Specifically, such a light detecting means em- 
bodying the present invention employ CCD cameras 
and photosensors. Examples of the light-emitting 
means Include, but are not limited to, Infrared light-emit- 
ting elements. Because infrared rays have directionality, 

IS the light-emitting means may be formed by employing 
a plurality of llght-emltting elements that emit light in dif- 
ferent directions. 

[0028] According to another aspect of the present in- 
vention, there is provided a video game method for use 
20 in a game device in which a real Interface device oper- 
ated by a player within a real space is represented by a 
virtual interface device within a virtual space and dis- 
played on a screen. The video game method In this em- 
bodiment comprises: 

25 

a position detecting step for detecting the position 
of the real interface device within the real space; 
a conversion step for converting the detected real 
position into a position within the virtual space and 
30 determining the display position of the virtual Inter- 
face device on the screen based on its virtual posi- 
tion; and 

an operating step for displaying the movements of 
the virtual interface device on the screen by causing 
35 the position detecting means to detect the real po- 
sition of the real interface device, and the conver- 
sion means to determine the display position of the 
virtual interface device, at predetenminedtime inter- 
vals AT^. 

40 

[0029] According to another aspect of the present in- 
vention, there Is a provided video game program that 
makes a computer execute each of the steps of the 
method cited above. Further, computer-readable stor- 
es age media on which this program is recorded are also 
included in the scope of the present invention. Examples 
of computer-readable recording media include, but are 
not limited to, floppy disks, hard disks, semiconductor 
memory, CD-ROMs, DVDs, magneto-optical disks 
50 (MOs) and other computer read/writeable recording me- 
dia. 

[0030] According to yet another aspect of the present 
invention, a real interface device for a video game de- 
vice is provided, in which the real interface device Is ma- 
ss nipulated by a player within a real space and is repre- 
sented by a virtual Interface device within a virtual 
space. The real interface device Includes a light-emitting 
means disposed thereon that emits light. A position of 
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the real Interface device within the real space is detected 
by a position detecting means disposed on the video 
game device that detects the light emitted from the light- 
emitting means and computes the position thereof with- 
in the real space. The real position of the real interface 
device is converted into a virtual position within the vir- 
tual space by a conversion means disposed in the video 
game device, the conversion means displaying the vir- 
tual interface device in the virtual position on a display. 
Movement of the virtual interface device is displayed on 
the display by an operating means disposed in the video 
game device, the operating means causing the position 
detecting means to detect the real position of the real 
Interface device and the conversion means to determine 
the virtual position of the virtual interface device at pre- 
determined time intervals AT^. 
[0031] For example, if the real interface device is a 
rod-shaped object such as a sword or bat, infrared light- 
emitting elements are mounted In two different spots 
along the centerline of the real interface device. In cases 
in which the real interface device has a planar portion, 
such as with a racket or shield, tight-emitting elements 
are installed in three different spots In the planar section. 
The real Interface device may be an object(s) that the 
player puts on his or her person, e.g., a hat, gloves, a 
belt, goggles, or footwear, and that is manipulated by 
his or her movements. With some of these objects, In- 
stalling just one light-emitting element may be ade- 
quate. Light from the light-emitting elements is detected 
by at least one pair of light-detecting means made up of 
CCD cameras or Infrared sensors, and the three-dimen- 
sional coordinates of the light-emitting means within the 
real space are calculated. 

[0032] According to yet another aspect of the present 
invention, a light-emitting means is disposed on a real 
interface devicefor a video game device. The real inter- 
face device is manipulated by a player within a real 
space and represented by a virtual interface device with- 
in a virtual space. The light from the light-emitting means 
is detected by at least a pair of light detection means 
disposed on the video game device. The position of the 
light-emitting means within the real space is measured 
by measurement means disposed on the video game 
device based upon the light detected by the light detec- 
tion means. The real position of the real interface device 
is converted into a virtual position within the virtual 
space by conversion means disposed on the video 
game device, the conversion means displaying the vir- 
tual Interface device in the virtual position on a display. 
The movement of the virtual interface device is dis- 
played on the display by an operating means disposed 
in the video game device, the operating means causing 
a position detecting means disposed on the video game 
device to detect the real position of the real Interface 
device and the conversion means to detemnine the vir- 
tual position of the virtual Interface device at predeter- 
mined time intervals AT^ . 

[0033] The light-emitting means is installed in a real 



Interface device that a player manipulates in the game 
device. The light-emitting means may be installed in an 
object(s) worn by the player on his or her person, if the 
real interface device is a pair of gloves, a hat, a belt, 

s footwear, etc. 

[0034] According to another aspect of the present in- 
vention, there is provided a position detecting means 
that detects the position of a real interface device that a 
player of a video game device manipulates within a real 

10 space. A position detecting means embodying the 
present Invention includes: 

a llght-emltting means installed In the real interface 
device; 

15 at least a pair of light-detecting means that detect 
light from the light-emitting means; and 
measuring means that measures the position of the 
llght-emltting means within the real space based 
upon the detected light and outputs the measure- 
20 ment results to the game device. 

[0035] A position detecting means embodying the 
present invention includes a pair of CCD cameras in- 
stalled, for example, on left and right upper portions of 
25 the game device console, and infrared light-emitting el- 
ements provided in the real Interface device. 
[0036] Another aspect of the present invention, there 
is provided a video game system that allows a player 
within a real space to play a video game within a virtual 
30 space. A video game system embodying the present in- 
vention Includes: 

a real interface device for the player to manipulate 
within the real space; 
35 display means for displaying a virtual intertace de- 
vice, the virtual interface device serving as a repre- 
sentation of the real interface device within the vir- 
tual space; 

position detecting means for detecting positioning 
40 of the real interface device within the real space; 
coordinate conversion means for converting the de- 
tected real position into a position within the virtual 
space, and based on the virtual position, determin- 
ing the display position of the virtual Interface device 
45 on the display means; and 

operating means for displaying movements of the 
virtual interface device on the display means that 
correspond to movements of the real interface de- 
vice manipulated by the player by causing the po- 
50 sition detecting means to detect the real position, 
and the coordinate conversion means to detennine 
the display position, of the virtual interface device 
at predetemnined time intervals A T^. 

55 [0037] These and other objects, features, aspects 
and advantages of the present invention will become ap- 
parent to those skilled In the art from the following de- 
tailed description, which, taken in conjunction with the 
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annexed drawings, discloses a preferred embodinnent 
of the present invention. 

[0038] Referrence will now be made, by way of exam- 
ple, to the accompanying drawings, in which: 

Fig. 1 is a block diagram illustrating the configura- 
tion of a video game system according to an em- 
bodiment of the present invention; 
Fig. 2 is an oblique view of the outward appearance 
of a combat video game device which employs the 
video game system illustrated In Fig. 1 ; 
Fig. 3 Is a lateral view of the combat video game 
device Illustrated in Fig. 2; 
Fig. 4 is a sword type of interface device used in the 
combat video game device illustrated In Fig. 2; 
Fig. 5 is an example of a screen displayed In the 
combat video game system illustrated In Fig. 2; 
Fig. 6 shows a player playing the combat video 
game device illustrated in Fig. 2; 
Fig. 7 shows the relationship between a sensor co- 
ordinate system and a player coordinate system in 
the combat video game device illustrated in Fig. 2; 
Fig. 8 shows the relationship between the player co- 
ordinate system and a game space coordinate sys- 
tem in the combat video game device illustrated in 
Fig. 2; 

Fig. 9 Is an example of a screen displayed in the 
combat game device illustrated In Fig. 2 that 
prompts a player Into a standard position; 
Fig. 10 is an example of a difficulty level selection 
screen displayed In the combat video game device 
illustrated in Fig. 2, in which the level of difficulty is 
selected with the sword type of interface device. 
Figs. 11 A and 11 B show the relationship between 
movement of the sword type of interface device and 
movement of the sword object in the combat video 
game device illustrated in Fig. 2; 
Figs. 12A and 12B show the relationship between 
movement of the sword type of Interface device and 
movement of the sword object In the combat video 
game device illustrated in Fig. 2; 
Fig. 1 3 is a trajectory table that indicates the trajec- 
tory of the sword object in the combat video game 
device illustrated In Fig. 2; 
Figs. 14A, 14B and 14C show the changes in the 
display when the foot pedal on the combat video 
game device illustrated in Fig. 2 Is pressed; 
Fig. 1 5 shows the change in the display in the com- 
bat video game device Illustrated in Fig. 2 when a 
player's remaining life has been reduced due to an 
opponent's attack; 

Fig. 1 6 shows a flowchart that illustrates the overall 
process of the combat video game device illustrated 

in Fig. 2; 

Fig. 1 7 shows a flowchart that illustrates a connec- 
tion process in the combat video game device illus- 
trated in Fig. 2; 

Fig. 1 8 shows a flowchart that illustrates the difficul- 



ty level selection process in the combat video game 
device illustrated in Fig. 2; 
Fig. 19 shows a flowchart that illustrates a coordi- 
nate conversion process In the combat video game 

5 device illustrated in Fig. 2; 

Figs. 20A, 208, and 20C show an example of an- 
other method of detennining whether or not an ob- 
ject in the virtual space has been struck; and 
Fig. 21 shows an example of another method of de- 

10 tennining the input of a preset command. 

[0039] Embodiments of the present invention will now 
be described with reference to the accompanying draw- 
ings. 

IS 

1 . Overview Of The Invention 

[0040] In the present Invention, the movement of a re- 
al Interface device that a player controls within a real 

20 space R Is displayed as the movement of a virtual inter- 
face device within a game space G. For example, in 
combat video games in which a player takes up a sword 
and battles with an enemy, the swinging and thrusting 
movements of the sword wielded by the player are con- 

25 verted Into and displayed as the movements of a sword 
object within the game space G. As a further example, 
in a situation where a player plays a tennis game within 
the game space G, the movements of the racket wielded 
by the player are converted into and displayed as the 

30 movements of a racket wielded by an animated charac- 
ter that represents the player within the game space G. 
[0041 ] The present invention is also applicable to vid- 
eo games other than combat and sports games. For ex- 
ample, a game in which points are scored by having an 

35 animated character within the game space G jump to 
avoid obstacles is also made possible by the present 
invention. In order to convert the player's own move- 
ments into the movements of the animated character, 
the player may be asked to put on a hat, footwear gog- 

40 gies, a belt, gloves, or other type of device, and the ob- 
ject(s) worn may serve as the real interface device(s). 

2. First Embodiment 



[0042] Fig. 1 is a block diagram illustrating a game 
system 1000 according to a first embodiment of the 
present Invention. The game system 1000 includes a 
control section 1 , an Image processor 2, an audio proc- 
essor 3, a semiconductor memory 4, an operating sec- 
tion 5, and a position detector 6. 
[0043] The control section 1 includes a CPU 1 0, ROM 
18 and a RAM 19. The CPU 10 conducts a number of 
functions based on an operating system (OS) stored in 
the ROM 18 and on game data stored in the RAM 19. 
These will be described in greater detail below. The OS 
stored in ROM 1 8 controls each portion of the game sys- 
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tem 1000, and the RAM 19 is used as a work area that 
temporarily saves various game data which is read out 
from the semiconductor memory 4 as needed. 
[0044] The image processor 2 includes a GPU 
(graphics processing unit) 21 , a frame buffer 22, and a 
monitor 23. Based on calculations made by the CPU 10, 
the GPU 21 writes CG images made up of polygon com- 
binations Into the frame buffer 22, and are stored in the 
frame buffer 22 temporarily The CG images stored in 
the frame buffer 22 are read out and displayed by the io 
monitor 23. Continuous processing and storing of CG 
Images into the frame buffer 22 by the GPU 21 results 
in the display of an animated CG Image on the monitor 
23. 

[0045] The audio processor 3 includes an SPU 
(sound processing unit) 31 and a speaker 32. The SPU 
31 plays music and sound effects based upon musk: da- 
ta and a variety of sound effects data. 
[0046] Game programs are recorded In the semicon- 
ductor memory 4. 

[0047] The operating section 5 includes a real inter- 
face device 51 and controllers 52. The real interface de- 
vice 51 Is an Input meansthata player manipulates with- 
in the real space R. The position detector 6 measures 
the position of the real interface device 51 in the real 
space B, and the measurement data therefrom Is used 
to move a virtual interface device within the game space 
G such that the virtual Interface device is a transposition 
of the real interface device 51 . in addition, the real In- 
terface device 51 may also be utilized both as an input 
means and an output means. For example, If the real 
interface device 51 Is provided with a vibration means, 
and the virtual Interface device collides with an object 
within the game space G, the vibration means in the real 
interface device 51 could be made to vibrate in response 
thereto. The controllers 52 are preset switches, buttons, 
joysticks, foot pedals, and other similar control mem- 
bers. The controllers 52 are input means for controlling 
objects and/or the virtual interface device within the 
game space G, and are manipulated by the player. 
[0048] As noted above, the position detector 6 is a 
means for detecting the position of the real Interface de- 
vice 51 In the real space R. The position detector 6 em- 
ploys, for example, light-emitting means installed in the 
real Interface device 51 and a pair of sensors for sensing 
light emitted from the light-emitting means. The position 
detector 6 further Includes a measurement unit that de- 
termines the position of the real Interface device 51 In 
the real space R, based upon the light emitted from the 
light-emitting means, and sends this position data to the 
control section 1 . The position data sent to the control 
section 1 is, for example, expressed in three-dimension- 
al coordinates in the real space R, numbers represent- 
ing sub-spaces subdivided from within the real space, 
or another type of coordinate system known to one of 
ordinary skill in the art. 

[0049] Instead of the aforementioned light-emitting 
means, It is also possible to utilize ultrasound signal- 



emitting means Installed in the real interface device 51 , 
together with a pair of sensors that receive sound from 
the ultrasound signal-emitting means. 



[0050] Fig. 2 Is an oblique view of the outward appear- 
ance of a combat video game system 2000 In which the 
foregoing game system 1000 is employed, and illus- 
trates one example in which the present invention is ap- 
plied to a combat video game. The combat video game 
system 2000 includes a game device 1 00, and a sword 
type of Interface device 200 (hereinafter referred to as 
"sword 200") that serves as one example of a real inter- 
face device 51 . The sword 200 is connected to the game 
device 100 by an RS232C connection or other similar 
type of connector. A cable supplying power from the 
game device 100 Is also connected to the sword 200. 
Note, however, that it would be readily apparent to one 
of ordinary skill in the art that the sword 200 could be 
powered by an independent power source (such as a 
battery pack), and that the sword 200 could be config- 
ured to be connected to the game device 100 via any 
one of a number of wireless connections available on 
the market. 

[0051] A monitor 1 01 for image output is provided on 
the upper front upper portion of the game device 100 
console. CCD cameras 102a and 102b, which are only 
one example of sensors included in the position detector 
6, are installed on the left and right uppermost portions 
of the console. The CCD cameras 1 02a and 1 02b detect 
light from the light-emitting means installed in a prede- 
termined location on the sword 200. Although not shown 
in the figure, a position measurement means is connect- 
ed to the CCD cameras 102a and 102b, and specifies 
the light-emitting positions In the real space R based on 
the light detected by the CCD cameras 102a and 102b. 
A pair of bars 1 03 project out of the left and right sides 
of the rear upper portion of the console and extend for- 
ward therefrom, and protective curtains 104 are in- 
stalled on the bars 103. The protective curtains 104 
serve to protect the area sun^oundlng the game device 
100 when a player is brandishing the sword 200 In the 
play space. Speakers 1 05 (which are examples of the 
speaker 32 depicted in Fig. 1) are Installed on both the 
left and right sides of the upper portion of the monitor 
101 , and serve to output game background music and 
sound effects to the player. Switches 106 are provided 
in the middle of the lower portion of the console, and 
allow the player to select menus that are displayed on 
the monitor 101 . The switches 106 are one specffic ex- 
ample of the controllers 52 described above. Afoot ped- 
al 1 07 is provided at floor level on the front of the con- 
sole. By stepping on the foot pedal 10, a player is able 
to manipulate a sword object that represents the sword 
200 in the game space G. The foot pedal 1 07 is another 
specific example of the controllers 52 described above. 
A coin deposit slot 108 is provided in the middle of the 
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lower portion of the console, and serves to accept coins 
inserted by the player in order to pay for the game. 

B-1 . The Game Device 

[0052] Fig. 3 is a lateral view of the game device 1 00 
shown in Fig. 2. As this figure shows, the bars 1 03 are 
rotatably installed on fulcrums 110 in the rear of upper 
part of the console, and project forward horizontally from 
the fulcrums 1 1 0. Gas springs 1 09 are fitted to the bars 
103, and through the extension/compression thereof, 
the bars 1 03 are rotatable around the fulcrums 1 1 0 with- 
in a fixed range in the direction of the arrow in the figure. 
Even on the rare instance that someone was to dangle 
from the protective curtains 1 04, the protective curtains 
104 are prevented from coming off the bars 103 be- 
cause the bars 103 are rotatably installed on the con- 
sole. 

B-2. The Sword 

[0053] Fig. 4showsthedetailedstructureof thesword 
200. The sword 200 includes a grip 201 and a blade 202. 
The blade 202 is composed of a clear plastic. Two light- 
emitting means 203a and 203b are installed in the inte- 
rior of the blade 202 at two predetermined points and 
Q2 that are in different positions along the axial direction. 
Light from the light-emitting means 203a and 203b is 
detected by the CCD cameras 102a and 102b respec- 
tively. The light-emitting means 203a and 203b are not 
particularly limited, but may for example include LEDs 
that emit infrared light. Because of the directionality in 
the orientation of the light emitted from LEDs, the light- 
emitting means is preferably composed of a plurality of 
LEDs. 

[0054] A vibrating means 204 for vibrating the sword 
is provided in the interior of the grip portion 201. The 
vibrating means 204 may be composed of an eccentric 
cam and a motor for rotating the eccentric cam. As will 
be described later in greater detail, when the sword ob- 
ject in the game space G is determined to have struck 
an enemy or another object, the motor will be driven to 
rotate the eccentric cam, which in turn vibrates the 
sword 200. By adjusting the interval of the motor drive 
pulse, the rotational speed of the eccentric cam may be 
controlled to strengthen and/or wealcen the vibration. 
Further, switches 205a and 205b are provided on the 
grip portion 201 . The switches 205a and 205b are uti- 
lized to select from menus that appear on the monitor 
101 . In addition, a cable 206 that transmits electric cur- 
rent to drive the aforementioned motor, and a cord for 
hanging the sword 200 on the main unit, are both pro- 
vided in the grip portion 201 . 

C, Overview Of The Combat Game 

[0055] Next, an overview of a combat video game 
played on the combat video game system 2000 will be 



explained using Figs. 1 and 5 through 18. Fig. 5 is a 
scene from the combat video game, and Fig. 6 shows a 
player playing the combat video game. In this video 
game, enemies holding weapons such as swords ap- 

5 pear in succession and assail the player. Utilizing the 
sword 200 connected with the game device 100, the 
player, as shown in Fig. 6, swings and thrusts the sword 
200 in order to control the sword object within the game 
space G. As noted above, the sword object Is a trans- 

10 position of the sword 200 within the game space Q. The 
player's score and a candle that signifies the amount of 
life remaining in the player are displayed in the upper 
left portion of the screen. The amount of life left for the 
enemy is displayed in the lower right portion of the 

15 screen. 

[0056] Prior to beginning the game, the player may 
select the level of difficulty, and may also select a weap- 
on, e.g., a knife, a spear, or a bow and arrows, In ac- 
cordance with the level of difficulty. The player advances 

20 and turns from one direction to another within the game 
space G by controlling the game system. Furthemnore, 
by stepping on the foot pedal 1 07, the player may move 
ahead a fixed distance in a predetermined direction 
within the game space G. When the player inflicts a pre- 

25 detemnined amount of damage on the enemy by knock- 
ing down foes encountered while moving within in game 
space G, the selected level of difficulty ends, and the 
player may then choose to move onto a higher level of 
difficulty. The game ends once the player's remaining 

30 life is gone. 

C-1 . Coordinate Conversion 

[0057] Figs. 7 and 8 show the coordinate conversion 
35 concept that fomis the foundation of the present combat 
video game. Three spatial coordinate systems are as- 
sumed in the present video game system. The first is a 
sensor coordinate system that utilizes the CCD cameras 
1 02a and 1 02b as references to establish the position 
40 of the sword 200 within the real space R with three-di- 
mensional coordinates. The second is a player coordi- 
nate system that utilizes the player as a reference to 
establish the position of the sword 200 within the real 
space R in three dimensional coordinates. The third is 
45 a game space coordinate system that establishes the 
position of the sword 200 within the game space G in 
three dimensional coordinates. 

C-1-1 . Conversion From A Sensor Coordinate System 
50 Used In The Real Space flTo A Player Coordinate 
System 

[0058] Fig. 7 shows the relationship between the sen- 
sor coordinate system and the player coordinate sys- 
55 tem. A cuboid whose boundaries are detectable with the 
CCD cameras 1 02a and 1 02b is assumed as the real 
space R. The cuboid assumed as the real space R in 
the present example hovers 50 cm from the floor surface 
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on which the game device 100 is placed, and extends 
up to the CCD cameras 1 02a and 1 02b disposed on the 
front of the game device 1 00. The height of the cuboid 
is 200 cm, the depth is 200 cm, and the width is 1 50 cm. 
The size of the cuboid is set to be within the sensing s 
capability of the CCD cameras 1 02a and 102b, and to 
be large enough to accommodate a player's move- 
ments. 

[0059] The sensor coordinate system will be ex- 
plained first. The sensor coordinate system is a system 
of coordinates in which a vertex Sq corresponding to 
CCD camera 102a Is the origin, an Imaginary line that 
extends from the CCD camera 1 02a to the CCD camera 
102b is the x-axis, an imaginary line that extends down 
from the CCD camera 1 02a is the y-axis, and an imag- 
inary line that extends out from the front of the game 
device Is the z-axis. Each edge of the cuboid represent- 
ing the real space R In the sensor coordinate system Is 
divided into 256 spaces, whose coordinates are ex- 
pressed as values from 0 to 255. For example, the co- 
ordinates of the vertex which corresponds to CDD 
camera 102b, will be (255, 0, 0) In this system. 
[0060] Next, the player coordinate system will be ex- 
plained. In this example, the origin Pq in the player co- 
ordinate system is a position on the foot pedal 107 fur- 
ther toward the front of the game device than the CCD 
cameras 102a and 102b. Assume for example that the 
foot pedal 107, at the front of the game device 100, is 
on the floor surface 60 cm f u rther to the front of the game 
device than CCD cameras 102a and 102b. Then, an x 
-axis and a z-axis extend in the same respective direc- 
tions as the jr-axis and z-axis in the foregoing sensor 
coordinate system, white a y-axis extends upward in a 
direction opposite that of the y-axis. Each coordinate ax- 
is is scaled with 1 cm Increments. In this player coordi- 
nate system, the coordinates of a point P3 where the y 
-axis Intersects with the lower plane of the real space R 
will be (0, 50, 0). Likewise, the coordinates of a point P2 
where the y -axis intersects with the upper plane of the 
real space R will be (0, 250, 0). 
[0061] As an example in which sensor coordinates 
are converted into player coordinates, consider the ori- 
gin Sq in the sensor coordinate system. The sensor co- 
ordinate system origin Sq (0, 0, 0) will be expressed as 
{-75, 250, -60) In the player coordinate system. 

C-1-2. Conversion From The Player Coordinate System 
To The Game Space Coordinate System 

[0062] Fig. 8 shows the relationship between the play- 
er coordinate system and the game space coordinate 
system. The game space G is a virtual space in which 
the video game is played, such as a virtual building, a 
virtual forest, or other area, and is a predetenmined size 
that is set by the video game supplier. A hypothetical 
game space G might be a cuboid 2000 m wide, 2000 m 
deep and 200 m high, for example. Taking the origin Gq 
(0, 0, 0) to be in the middle of one of the lower edges of 



the cuboid, an x -axis extends along the lower edge of 
the cuboid in which the origin Gq is placed, a z -axis ex- 
tends perpendicular to the x -axis and along the bottom 
of the cuboid, and a y -axis extends upward perpendic- 
ular to the X -axis and the z -axis. Each coordinate axis 
is scaled with 1 m increments. 
[0063] The relationship between the player coordi- 
nate system and the game space coordinate system Is 
that the y -axis and the y -axis extend In the same di- 
rection, while the X-axis and the x-axis, and the z-axis 
and the z-axis, both extend in a parallel, but opposite, 
direction with respect to each another 
[0064] The origin Gq in the game space coordinate 
system and the origin Pq in the player coordinate system 
are the same when the game starts. Thereafter, when 
the player moves fon/vard to press on the foot pedal 1 07, 
or when the player advances or turns, the origins in the 
game space coordinate system and the player coordi- 
nate system gradually diverge. When the two origins are 
equal, the coordinates (-75, 250, -60) In the player co- 
ordinate system, which is the origin Sq in the sensor co- 
ordinate system, will be (75, 250, 60) in the game space 
coordinate system. It should be noted that the conver- 
sions described above for the coordinate systems are 
no more than a single example, and the coordinate sys- 
tem conversions can be generally performed utilizing a 
known method as an affine transfonnation. 
[0065] In the present combat video game system 
2000, the positions of the two points Q^, Q2 on the sword 
200 in the real space R are specified in the sensor co- 
ordinate system, and these coordinates are subse- 
quently converted into the player coordinate system and 
further into the game space coordinate system. The dis- 
play position of the sword object on the monitor 101 is 
determined by making a perspective-projection trans- 
fonnation of the coordinates in the game space coordi- 
nate system, and the sword object Is then displayed. 
This coordinate conversion allows a player to play a 
game without sensing incongruity between real space 
and the game space, by allowing him to move his body 
rather than just manipulating an object in the game 
space. 

C-2. Processes Performed By The CPU 

[0066] Referring again to Fig. 1 , the process which the 
CPU 10 perfomns will now be explained. The CPU 10 
includes correction means 11, difficulty level selection 
means 12, three dimensional input conversion means 
13, hit determination means 14, audio output control 
means 15, maneuver detenninatlon means 16, and sta- 
tus determination means 17. 
[0067] The correction means 11 perfomns a process 
that corrects for differences in player height. For exam- 
ple, the standard height of a player Is assumed to be 
170 cm. When the player is a child who Is shorter than 
1 70 cm, the correction means 11 performs a correction 
process to prevent the sword object from being awk- 
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wardly displayed only at the bottom of the screen. 
[0068] Specifically, prior to the start of the game the 
correction means 11 prompts the player into a basic 
stance. Fig. 9 is an example of a screen that the connec- 
tion means 1 1 displays In order to prompt the player into 
this stance. The correction means 1 1 deduces the play- 
er's height based upon the position of the sword 200 
when In this stance, and detennines a correction coef- 
ficient. For example, the correction means 11 assumes 
1 20 cm to be the standard height of the sword 200 when 
the player is in the basic stance. If the height of the sword 
200 detected from a player in the basic stance is 60 cm, 
I.e., half the standard height, the connection means 11 
determines the correction coefficient to be "2." From 
then on, the correction means 1 1 multiplies the detected 
height of the sword 200 by the correction coefficient 2, 
enabling the same display effects to be produced as with 
that of a standard player, even for small children. In fact, 
depending on the height of the player, it is also possible 
to use the different movements of the sword 200 to de- 
temnine the correction coefficient. Specifically, the 
movement of the sword 200 is expressed by the change 
in the combination of its previous positions and the di- 
rection in which it is traveling. Thus, for example, a meth- 
od can be provided that computes the correction coef- 
ficient from distributions in the range of travel of the 
sword 200. 

[0069] After, or prior to, the detemiination of the cor- 
rection coefficient by the correction means 11 , the level 
of difficulty of the game can be selected with the difficulty 
level selection means 12. The selection of a weapon in 
accordance with the level of difficulty can also occur 
while selecting the level of difficulty, or It can occur after 
the level of difficulty has been selected. The difficulty 
level selection means 12 utilizes the switch 106 installed 
in the game device 1 00, and the switch 205 on the sword 
200, in order to accept the difficulty level selection from 
the player. In addition, when a player points the sword 
200 at a menu on the monitor 101 that he or she has 
selected, the difficulty level selection means 12 displays 
a marker where a line that extends from the straight line 
joining the tight-emitting means 203a and 203b inter- 
sects the monitor 101. The difficulty level selection 
means 1 2 will then select the menu in which the marker 
Is placed when the player presses the switch 205. Fig. 
10 is an example of a difficulty level selection screen 
that the difficulty level selection means 12 displays. A 
marker indicating where the sword 200 is aimed is dis- 
played on the menu Item titled "Beginner Mode." 
[0070] The three dimensional input conversion 
means 13 carries out a coordinate transformation proc- 
ess that converts the sensor coordinates of the light- 
emitting means 203a and 203b in the sword 200 into 
player coordinates, and then into game space coordi- 
nates. Display of the sword object is carried out by com- 
puting its display position on the monitor 101 based on 
the game space coordinates calculated. The three di- 
mensional input conversion means 13 perfomis the co- 



ordinate transfomriation process at predetermined time 
intervals, e.g. every 16 msec. Accordingly, the move- 
ment of the sword 200 controlled by a player is thereby 
expressed as the movement of a sword object displayed 
5 on the monitor 101 . This enables a player to play the 
video game the feeling that they themselves are acting 
in it, rather than just feeling that they are controlling a 
sword object in the game. 

[0071] If for example a player has swung the sword 
10 200 as shown In Fig. 1 1 B, the same movement of the 
sword object will displayed on the screen, as illustrated 
in Fig. 11 A. Moreover, as shown in the same Fig. 11 A, 
the trajectory of the sword object will also displayed. 
Likewise, as shown in Figs. 12A and 12B, when an en- 
's emy appears and makes an attack on the player, if the 
player acts to stop the enemy's sword using the sword 
200, the sword object in the display will move in the 
same manner. 

[0072] The hit detennining means 14 detennines 

20 whether or not the sword object has struck an enemy or 
another object such as a rock or other object within the 
game space G. In the present game system, because 
the movements of the sword object controlled by the 
player are arbitrary and thus cannot be predicted by the 

25 system, the hit detennining means 1 4 stores the sword 
object's trajectory over a predetemiined time period * in 
order to detennine whether or not the sword object has 
struck another object and what that object is. 
[0073] Fig. 13 is a trajectory table in which the coor- 

30 dinates of two game space points q1 , q2 on the sword 
object are stored In a time series. The two game space 
points q1 and q2 corespond to the two points and 
Q2 on the sword 200. The three dimensional input con- 
version means 13 converts the coordinates of the two 

35 points and Qg on the sword 200 that are taken every 
16 msec, into game space coordinates q1, q2 for the 
sword object. The trajectory table then stores the coor- 
dinates of the two game space points q1 , q2 taken over 
the previous 256 msec in the RAM 19. 

40 [0074] Based on the coordinates of the two game 
space points q1 , q2 for the sword object, the hit deter- 
mining means 1 4 can establish a straight line that rep- 
resents the blade of the sword object. In addition, as- 
suming the point q1 is at the base of the blade, and the 

45 point q2 is near the tip of the blade, the tip of the blade 
can also be established with a point q3. The point q3 of 
the blade is a point in line with points q1 and q2, and a 
fixed distance d further along the blade from point q2. 
Utilizing the trajectory table, the hit detennining means 

50 1 4 will calculate a plane that expresses the linear tra- 
jectory of the blade. The hit detennining means 14 de- 
tennines whether or not the sword object has struck an- 
ything by detennining whether or not an enemy's sword, 
an enemy's body, or another object is within the plane 

55 calculated. 

[0075] In addition, the hit determining means 14 de- 
tennines the speed of the sword object by measuring 
the distances that points q1 and q2 have traveled every 



10 



19 



EP1 249 260 A2 



20 



1 6 msec. In accordance with the speed of the sword ob- 
ject, the hit determining means 14 will determine how 
deep it has entered an object. Furthermore, the hit de- 
termining means 14 will also detennine the degree to 
which the sword object has struck another object. For 
example, the hit determining means 14 will rate the hit 
as "cut clothing only", "body cuf, "slashed to the bone" 
or will determine that the attack has missed altogether. 
[0076] Note that when the sword 200 moves very 
quickly, there will be times when the stored sword object 
coordinates will not overlap with another object. It may 
happen that, for example, the sword object at time is 
on the left side of an enemy, and at time T2 is on the 
right side of the enemy. In this sort of situation as well, 
the hit determining means 14 will detennine that a hit 
has been made from the trajectory of the sword object 
blade. 

[0077] In accordance with the results of the hit deter- 
mination, the audio output control means 15 will output 
sound effect data to the speaker 32 that was read out 
from the semiconductor memory 4 to the RAM 19. The 
sound effects can include, but are not limited to, the 
sound of the sword striking another sword, the sound of 
the sword ripping an enemy's clothes, and the sound of 
the sword swishing as it misses. Because the sound ef- 
fects vary with the results of the hit detemiination, the 
realism of the game is improved. 
[0078] The maneuver detemnining means 16 deter- 
mines whether or not a prescribed command has been 
input based on the trajectory of the sword object. The 
prescribed commands are input according to predeter- 
mined trajectory patterns of the sword object and at- 
tacks on the enemies. The prescribed commands and 
the predetermined trajectory patterns are stored in the 
RAM 19 (and are not illustrated in the figures). For ex- 
ample, based on the foregoing trajectory table, the 
maneuver determining meansi 6 determines whether or 
not a player has input a cross pattern, i.e., one that is 
intended to kill the opponent. If this pattern has been 
input, an attack corresponding to the cross pattern is ex- 
ecuted. Thus, the player can have an even greater feel- 
ing that he himself is participating in the game. 
[0079] The maneuver detemnining means 1 6 also de- 
termines whether or not the foot pedal 107 has been 
pressed. If it has been pressed, the position of the origin 
PO in the player coordinate system is advanced in the 
game space G by the number of times pressed. The dis- 
tance that the player moves fonward in the game space 
G each time the foot pedal 1 07 is pressed is set before- 
hand to be, for example, 1 m. In response to the player's 
advance, the maneuver detemnining means 16 also 
shifts the game space coordinates for the sword object. 
Figs. 14Aand 14B are screen shots showing the chang- 
es in the display when the foot pedal 107 has been 
pressed. Fig. 14A is a screen shot illustrating a situation 
in which the sword object will not strike the opponent 
because the player Is too far away from him. Fig. 148 is 
a screen shot illustrating what occurs when the player 



presses on the foot pedal 1 7 (as shown in Fig. 1 4C) and 
swings the sword object. As illustrated in the figure, the 
player moves closer to the opponent in the game space 
G (i.e., the image is zoomed up), thereby allowing the 

s player's sword object to strike the opponent. By de- 
pressing the foot pedal 1 07, and at the same time using 
his or her entire body to attack the opponent, the player 
can feel a sense of presence In the game. 
[0080] In addition to these processes, the maneuver 

10 determining means 16 also determines whether or not 
the player has used a predetermined weapon — e.g., a 
knife which can be thrown. For instance, with the sword 
200 pointed at an opponent on the screen, a knife can 
be thrown at the targeted opponent if the switches 205a 

IS and 205b are pressed to order that the knife be thrown. 
When the line extending through the two points Q^, 
on the sword 200 intersects an opponent on the screen, 
a marker lndk;ating that the player has targeted that op- 
ponent is preferably displayed. 

20 [0081] In accordance with the hit detemnination re- 
sults and the maneuver detennination results, the status 
detemnining means 1 7 calculates the amount of damage 
on the opponent and the remaining life in the player. For 
example, when the hit determination results are that on- 

25 ly an opponent's clothing has been ripped, the opponent 
damage level will be "0." When the opponent has only 
been grazed or knocked down, the opponent damage 
level will be increased a fixed amount. The degree of 
damage to the opponent, and degree to which the op- 

30 ponent damage level has been increased, are both 
stored in the RAM 1 9 (not shown in the figures). 
[0082] When the results of the maneuver determina- 
tion are that a prescribed command has been input or 
that a weapon has been used, the status detemnination 

35 means 1 7 increases the opponent damage level to the 
degree con^esponding to the prescribed command or 
weapon used. The prescribed commands and the 
weapons, as well as the degree of increase in the op- 
ponent damage level, are stored in the RAM 19 (not 

40 shown in the figures). 

[0083] Meanwhile, the status detemnining means 17 
updates the amount of life remaining in the player in ac- 
cordance with the position of the opponent, the position 
of the player, and the movement of the player, in the 

45 game space Q. In situation in which the player was not 
able to prevent an enemy attack, the amount of life that 
the player has remaining will be decreased by a prede- 
temnined amount per round of enemy attack. Fig. 15 is 
a screen shot in which the status determining means 1 7 

50 lowers the amount of life remaining in a player who has 
undergone an enemy attack. 
[0084] Furthermore, the status determining means 1 7 
will vibrate the sword 200 in response to a hit by activat- 
ing the motor 204 disposed in the handle 201 of the 

55 sword 200. The video game is made more realistic be- 
cause will not only see that he has struck something, 
but also physically feel it due to the vibration. Moreover, 
the game will feel more realistic because the strength of 
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the vibration provided can be varied according to the 
strength of the hit. 

C-3. Process Flow 

[0085] Figs. 16 through 19 are flowcharts illustrating 
the flow of the overall processes/procedures in the 
present combat video game system 2000. Below, de- 
tails on the flow of the processes in the present game 
system will be explained with reference to these figures. 

C-3-1. Main Routine 

[0086] Fig. 1 6 is a flowchart illustrating the flow of the 
main routine of the present video game system. This 
routine is begun by a player inserting a coin into the coin 
deposit slot 108 in the game device 100. 
[0087] Step S1 : The con-ection means 11 carries out 
the correction process noted above, and calculates a 
correction coefficient in order to con-ect for the player's 
height. This process will be described below when dis- 
cussing Fig. 1 7. 

[0088] Step S2: The difficulty level selection means 

12 accepts the selection of a difficulty level by a player, 
such as beginner, intennediate, or advanced. This proc- 
ess will be described below when discussing Fig. 18. It 
should be noted that the difficulty level selection process 
may be perfonned prior to the correction process noted 
above. 

[0089] Step S3: Data is loaded after the correction 
process and the difficulty level selection process. In oth- 
er words, the game program and data required during 
the course of the game are read into the RAM 1 9 from 
the semiconductor memory 4. When the data Is loaded, 
a game screen such as the one shown in Fig. 11 is dis- 
played and the game begins. 
[0090] Step S4: After the game has begun, the proc- 
esses in steps S5 through SI 8 are carried out at prede- 
tennined time intervals. In the present example, that 
time interval is set at 16 msec. 
[0091] Step S5: The three dimensional input conver- 
sion means 13 acquires the sensor coordinates of the 
sword 200 in the real space flfrom the position detector 
6 every 1 6 msec. 

[0092] Step S6: Next, the three dimensional input 
conversion means 13 converts the acquired sensor co- 
ordinates into player coordinates, and then into game 
space coordinates. This process will be described in 
greater detail below. The game space coordinates are 
then written into the trajectory table In the RAM 19 by 
the hit detenminlng means 14. 
[0093] Step S7: The game space coordinates are 
then transfonmed into a perspective projection by the 
three dimensional input conversion means 13 In order 
to calculate the display position of the sword object on 
the monitor 101. The sword object is accordingly dis- 
played on the monitor 101 . In other words, the sword 
object will be displayed every 1 6 msec during the course 



of the game. 

[0094] Steps SB, S9, S1 0: The hit detemnining means 
1 4 detemriines the trajectory of the sword during the past 
256 msec from the trajectory table, and at Step SB de- 

5 tennines whether or not the sword object has struck an 
enemy or an object other than an enemy. If there has 
been a hit on the enemy, the level of damage to the en- 
emy Is calculated at Step S9 by the status detennining 
means 17. If, however, the object struclc is something 

10 other than the enemy, the opponent damage level will 
not change. In addition, the sword 200 will be vibrated 
at Step S10 in accordance with the object and the force 
with which it was struck, i.e., the status detennining 
means 17 will vary the drive pulse intervals for the motor 

15 204 built into the sword 200. For example, the reality of 
the game may be heightened by imparting a strong vi- 
bration to the sword 200 when the enemy has been 
knocked down and only a weak vibration when the en- 
emy is grazed. 

20 [0095] Step S1 1 : The audio output control means 1 5 
outputs sound effects in accordance with the hit deter- 
mination results. 

[0096] Steps SI 2, SI 3: At Step SI 2, the maneuver 

detennining means 1 6 detemnlnes whether or not a pre- 

25 scribed command has been input. In other words, the 
maneuver detennining means 1 6 determines the trajec- 
tory of the sword object within the game space G based 
on the data in the trajectory table, and detennines 
whether or not the trajectory con-esponds to a predeter- 

30 mined pattern. Discrepancies In the predetemnined pat- 
tern are tolerated to a certain extent in making this de- 
tennination. If the trajectory corresponds a prescribed 
command, then at Step S13 the status detennining 
means 17 raises the opponent damage level to the de- 

35 gree that is associated with the prescribed command, 
and updates the display. If a prescribed command has 
not been input, then nothing is done. 
[0097] Steps SI 4, S15, SI 6: At Step SI 4. the maneu- 
ver detennining means 16 determines whether or not 

40 the player is pointing the sword 200 at an enemy on the 
monitor 101, and if so, displays a marker thereon. The 
marker may, for example, be a circle encompassing the 
targeted enemy. At Step SI 5, It is detennined whether 
or not a weapon has been discharged toward the tar- 

45 geted enemy (e.g., a knife is thrown at the enemy). At 
Step SI 6, if a weapon has been discharged toward the 
targeted enemy, the status detenminlng means 17 will 
increases the level of opponent damage by an amount 
associated with that type of weapon, and then update 

50 the display. 

[0098] Step SI 7: Depending on whether or not the 
player's sword object has warded off an attack from the 
enemy, the status determining means 1 7 calculates the 
amount of player life remaining and updates the display. 

55 For example, if It is detennined that an enemy's sword 
object and the player's sword object have struck, the hit 
detennining means may determine that the enemy's at- 
tack was fended off. Conversely, if an enemy has at- 
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tacked the player and the player's sword object has not 
struck the enemy's sword object, it may be determined 
that the player has been injured. 
[0099] Step SI 8: 1 n this step, It is determined whether 
or not the player has any life remaining. If the player 
does not have any life remaining, then the process 
moves to Step S1 9. If the player does have life remain* 
ing, the routine returns to Step S4, and the S4-S1 8 proc- 
ess is repeated every 16 msec. 
[0100] Steps S19, S20, S21 , S22: At Step S20, it is 
determined whether or not the selected stage has been 
cleared, and if it has not been cleared, "Game Over" is 
displayed and the game is temninated. If it has been 
cleared, the player's results are displayed at Step S21 , 
and then at Step S22 a screen asking the player whether 
or not he or she wants to continue will be displayed. If 
"Continue" is selected, the routine returns once more to 
Step S2, and that process is again carried out. If "End" 
is selected, the game tenminates. 

C-3-2. Correction Routine 

[0101] Fig, 17 shows the correction process carried 

out in Step SI of the main routine. At Step S101, the 
correction means 11 displays the screen shown in Fig. 
9, which prompts the player to assume the baste stance. 
At Step SI 02, the correction means 11 stands by for a 
fixed period of time, and then detects the sensor coor- 
dinates of the two points , Q2 on the sword 200. The 
player's height is then estimated from the sensor coor- 
dinates read, and the correction coefficient Is deter- 
mined. 

C-3-3. Difficulty Level Selection Routine 

[0102] Fig. 1 8 shows the difficulty level selection proc- 
ess conducted in Step S2. This flowchart explains what 
occurs when the sword 200 is used to make a menu 
selection. 

[01 03] Steps S201 , S202, S203: At Step S201 , the dif- 
ficulty level selection means 12 reads in the sensor co- 
ordinates forthe two points Q^, Q2 on the sword 200. At 
Step S202, the difficulty level selection means 12 cal- 
culates the point in real space where the imaginary line 
extending from the tip of the sword 200 intersects the 
monitor 1 01 . At Step 203, the difficulty level selection 
means 12 then calculates the screen coordinates in 
which the imaginary line intersects with the monitor 1 01 . 
[0104] Steps S204, S205, S206: At Step S204, the dif- 
ficulty level selection means 12 will display a marker on 
the point on the monitor 1 01 that was determined in Step 
S203. At Step S205, when either of the switches 205a 
or 205b on the sword 200 is pressed with the marker 
placed on a menu option on the monitor 101 , the diffi- 
culty level selection means 12 will select the level of dif- 
frculty indicated. 

[0105] As described earlier, the selection of the level 
of difficulty and weapon to be used may be accom- 



plished through a switch on the game device main unit, 
or through a switch on the sword 200. 

C-3-4. Coordinate Conversion Routine 

5 

[0108] Fig. 1 9 shows the coordinate conversion proc- 
ess conducted in Step S6 of the main routine. 
[01 07] At Step S601 , the three dimensional Input con- 
version means 13 uses the correction coefficient deter- 
10 mined in Step SI and corrects the two sensor coordi- 
nates of the sword 200 in the real space R. Accordingly, 
the actions of all players are made equivalent to the ac- 
tions of a standard player, regardless of differences In 
height. 

15 [0108] At Step S602, the three dimensional input con- 
version means 13 converts the values of the corrected 
sensor coordinates into player coordinates in the player 
coordinate system, and then at Step S603 converts the 
player coordinates into game space coordinates in the 

20 game space coordinate system. At Step S604, it per- 
forms a perspective projection transformation on the 
game space coordinates of the sword 200 in order to 
calculate the position in which the sword object will be 
displayed on the monitor 1 01 . 

25 

3. Other Embodiments 

A. Another Example of Converting A Position In The 
Real Space Into A Position In The Game Space 

30 

[0109] Depending on the type of video game and on 
the type of virtual Interface device employed, a position 
in the real space R and a position in the game space Q 
may be specified with something other than three di- 

35 mensional coordinates. For example, the real space R 
and the game space G can be respectively partitioned 
into a number of real cells r1 , r2, . .. and virtual cells g1 , 
g2, ... of predetemnined size, and a cell storage member 
can be provided that stores both the cell numbers iden- 

40 tifying each cell, and the position of each ceil. 

[0110] In this modification, the three dimensional in- 
put conversion means 13 will convert the three dimen- 
sional coordinates position detector 6 into real cell num- 
bers, convert the real cell numbers into virtual cell num- 

"^5 bers, and then detemiine the display position of the 
sword object based on the virtual cell numbers. 

B. Another Example of How The Origin In The Player 
Coordinate System Is Chosen 

50 

[0111] It is also possible to make the both origin in the 
player coordinate system and the size of the increments 
on the coordinate axes different, depending upon the 
height of the player This allows the game to be adjusted 
55 for the height of the player. For example, the correction 
means 11 will store a player coordinate system in which 
one particular height is considered to be the standard. 
[0112] If a player is determined to be taller than this 
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standard height by the correction nneans at Step S1 , the 
position of the origin in the player coordinate system will 
be lowered beneath the standard position, and the size 
of the increments on the coordinate axes will be made 
larger tf the player is detemnined to be shorter than the 
standard height, the opposite process will be carried out. 

C. Another Example of Hit Detemfiinatlon 

[01 1 3] Figs. 20A, 20B, and 20C illustrate a method of 
speeding up the ability of the hit detennining means 14 
to detemiine whether or not the sword object has struck 
a target object. The solid lines shown in Fig. 20A indicate 
the position of the blade of the sword object in the game 
space G at a time and a time T2, with time Tg being 
16 msec after T.,. Fig. 20B shows the blade of the sword 
object represented by N number of points at time and 
time T2. Rg. 20C shows the trajectory of the sword ob- 
ject between times and Tg as represented by the W 
number points on the blade thereof. 
[0114] In order to detemriine whether or not the sword 
object has struck something between times and Tg, 
the hit detemnining means 1 4 will calculate the distances 
between each point on the sword object and the target 
object. If the distance between one or more of the points 
is determined to be at or below a predetermined value, 
then it is determined that the target object has been 
struck by the sword object. This method speeds up the 
ability of the hit determining means 14 to detemiine 
whether or not the sword object has struck a target ob- 
ject, because it does not require one or more points on 
the sword object to actually overlap a target object in 
order for a hit detemnination to be made. Instead, the 
target object need only be within a predetennined dis- 
tance of one or more of a reduced number of points on 
the sword object. This allows the computational load 
placed on the CPU 10 to be reduced, and thus allows 
the hit determination to be made more quickly. 

D. Another Example Of Detennining Whether Or Not A 
Prescribed Command Has Been Entered 

[01 1 5] The maneuver detennining means 1 6 may de- 
termine whether or not a prescribed command has been 
input in a manner different from that described above. 
Fig. 21 is a diagram of a real space /? partitioned into a 
suitable number of sub-spaces (hereinafter refen^ed to 
as "cells"). In the same way as described above, the real 
space flispartitionedintoa number of real cells r1 , r2, ... 
and cell numbers for identifying the cells are ascribed to 
each real cell. The maneuver determining means 16 
stores the cell numbers in the sequence in which the 
two points 0^ and Qg on the sword 200 have passed 
through the cells within a predetennined time period A 
t|. From the stored celt numbers, the maneuver deter- 
mining means 1 6 then compares the pattern of passage 
through the real cells with a prescribed pattern to deter- 
mine whether or not a prescribed command has been 



input. 

E. Modifications To The Real Interface devk:e 

5 [0116] Vibration may be provided in two or more plac- 
es on the real interface device. For example, a vibration 
means can be place at both ends of the sword 200, 
which allows the strength of the vibration applied to the 
sword 200 to be varied according to the object struck by 

10 the sword object in the game space. For example, both 
vibrating means could be activated when the player's 
sword object strikes an enemy's sword object, while only 
one vibrating means could be activated when the play- 
er's sword object strikes a softer object. 

15 [0117] Moreover, output means other than the vibra- 
tion means may be installed on the real interface device. 
For example, an audio output means, a light output 
means, or the like could be Installed on the real interface 
device in accordance with the nature of the video game. 

20 

F. Programs and Recording Media 

[01 1 8] Software programs that execute the aforemen- 
tioned game method on a computer are included in the 

25 scope of the present invention, as too are computer- 
readable recording media on which the programs are 
recorded. Computer-readable recording media include, 
but are not limited to, floppy disks, hard disks, semicon- 
ductor memory, CD-ROMs, DVDs, magneto-optical 

30 disks (MOs) and other computer-read/writeable record- 
ing media that would allow the aforementioned software 
programs to be stored thereon. 
[0119] Although the above description has referred to 
a program stored on a computer- readable medium, it 

35 will be appreciated that a computer program embodying 
the present invention need not be sotred on a computer- 
readable medium and couid, for example, be embodied 
in a signal such as a downloadable data signal provided 
from an Internet website. The appended claims are to 

40 be interpreted as covering a computer program by itself, 
or as a record on a carrier, or as a signal, or in any other 
fcorm. 

[0120] This application claims priority to Japanese 
Patent Application No. 2001-096856. The entire disclo- 

45 sure of Japanese Patent Application No. 2001 -096856 
is hereby incorporated herein by reference. 
[0121] While only selected embodiments have been 
chosen to illustrate the present invention, it will be ap- 
parent to those skilled in the art from this disclosure that 

50 various details of the above-described embodiments of 
the invention may be changed without departing from 
the scope of the invention. Furthennore, the foregoing 
description of the embodiments according to the present 
invention are provided for illustration only, and not for 

55 the purpose of limiting the invention as defined by the 
appended claims and their equivalents. 
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Claims 

1 . A video game device in which a real interface device 
that a player within a real space nnanipulates is rep- 
resented by a virtual Interface device within a virtual s 
space, the video game device comprising: 

position detecting means that detects a real po- 
sition of the real interface device; 5. 
conversion means that converts the real posi- io 
tion of the real interface device into a virtual po- 
sition within the virtual space, and displays the 
virtual interface device within the virtual posi- 
tion on a display; and 

operating means that displays movements of '5 
the virtual Interface device on the display, the 
operating means causing the position detecting 
means to detect the real position of the real In- 
terface device and the conversion means to de- 
temfiine the virtual position of the virtual inter- 20 
face device at predetemnined time intervals 



2. The video game device set forth in claim 1 , wherein: 

the real positions are real three-dimensional 
coordinates; 

the virtual positions are virtual three-dimen- 
sional coordinates; and 

the conversion means converts the real three- 
dimensional coordinates into virtual three-di- 
mensional coordinates, and determines the vir- 
tual position of the virtual interface device on 
the display based on the virtual three-dimen- 
sional coordinates. 

3. The video game device set forth in claim 1 , wherein 
the position detecting means detects the coordi- 
nates of at least two points on the real interface de- 
vice, and the video game device further comprises: 



an intersection display control means that cal- 
culates a point in which an imaginary straight 
line that extends between the points on the real 
interface device intersects with the display and 
displays a marker thereon; and 
selection accepting means that determines 
whether or not the point lies on an object being 7. 
displayed on the display, and allows the player 
to select the object if the point lies thereon. so 



4. The video game device set forth in claim 1 , further 

comprising: 

first trajectory storing means that stores the vir- 
tual position of the virtual Interface device taken 
at predetennined time intervals A T2, 
hit determining means that calculates a trajec- 



tory and speed of the virtual interface device 
based upon the virtual positions stored in the 
first trajectory storing means, detennines 
whether or not the virtual Interface devk^e has 
struck an object within the virtual space based 
on the trajectory and speed, and specifies the 
object struck if a strike has occurred. 

The video game device set forth In claim 1 , further 
comprising: 

second trajectory storing means that stores the 
virtual position of the virtual Interface device 
taken at predetermined time intervals AT3; 
command storage means that stores a plurality 
of commands that are associated on a one-to- 
one basis with a plurality of predetennined tra- 
jectory patterns of the virtual interface device; 
and 

command execution means that calculates a 
trajectory of the virtual interface device based 
upon the virtual positions stored in the second 
trajectory storing means, determines whether 
or not the trajectory matches any of the prede- 
25 termined trajectory patterns, and executes the 

command associated with the predetemnined 
trajectory pattern If a match exists. 

6. The video game device set forth In claim 1 , further 
30 comprising: 

third trajectory storing means that stores the re- 
al positions of the real interface device taken at 
predetennined time intervals AT4; 
35 command storage means that stores a plurality 

of commands that are associated on a one-to- 
one basis with a plurality of predetennined tra- 
jectory patterns of the real interface device; and 
command execution means that calculates a 
40 trajectory of the real interface device based up- 

on the real positions stored In the third trajec- 
tory storing means, determines whether or not 
the trajectory matches any of the predeter- 
mined trajectory patterns, and executes the 
command associated with the predetennined 
trajectory pattem If a match exists. 

The video game device set forth in claim 1 , com- 
prising: 

correction means that detects any difference 
between the player's height and a predeter- 
mined standard height based upon the real po- 
sition of the real interface device, and corrects 
55 the virtual position of the virtual interface device 

if any differences exists. 

8. The video game device set forth in claim 1 , wherein 
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the position detecting means further comprises: 

light emitting means provided on the real inter- 
face device; 

at least a pair of light detecting means that de- 
tect light from the light emitting means; and 
measuring means that measures the position 
of the light emitting means based on the light 
detected therefrom, and outputs the position of 
the tight emitting means to the conversion 
means. 

9. A video game method employed in a video game 

device in which a real interface device that a player 
within a real space manipulates is represented by 
a virtual Interface device within a virtual space, the 
game method comprising the steps of: 

detecting a real position of the real interface de- 
vice within the real space; 
converting the real position of the real Interface 
device into a virtual position within the virtual 
space, and displaying the virtual interface de- 
vice on a display within the virtual position; and 
displaying movement of the virtual interface de- 
vice on the display by causing the real position 
of the real interface device to be detected and 
the virtual position of the virtual interface device 
to be determined at predetermined time inter- 
vals AT^, and storing the virtual positions in 
memory. 

10. A video game program employed in a video game 
device in which a real interface device that a player 
within a real space manipulates Is represented by 
a virtual interface device within a virtual space, the 
video game program causing a computer to execute 
the steps of: 

detecting a real position of the real interface de- 
vice within the real space; 
converting the real position of the real interface 
device into a virtual position within the virtual 
space, and displaying the virtual interface de- 
vice on a display in the virtual position; and 
displaying movement of the virtual interface de- 
vice on the display by causing the real position 
of the real interface device to be detected and 
the virtual position of the virtual interface device 
to be detemnined at predetermined time inter- 
vats AT^, and storing the virtual positions in 
memory. 

1 1 . A real interface device for a video game device that 
a player within a real space manipulates, and which 
is represented by a virtual interface device within a 
virtual space, the real interface device comprising: 



a light-emitting means disposed thereon that 
emits light; and wherein 
a position of the real interface device within the 
real space is detected by a position detecting 
5 means disposed on the video game device that 

detects the light emitted from the light-emitting 
means and computes the position thereof with- 
in the real space; 

the real position of the real interface device is 
10 converted into a virtual position within the virtu- 

al space by a conversion means disposed in the 
video game device, the conversion means dis- 
playing the virtual interface device in the virtual 
position on a display; and 
IS movement of the virtual Interface device is dis- 

played on the display by an operating means 
disposed in the video game device, the operat- 
ing means causing the position detecting 
means to detect the real position of the real in- 
20 terface device and the conversion means to de- 

temnine the virtual position of the virtual Inter- 
face device at predetermined time intervals 
AT,. 

25 12. A light-emitting means disposed on a real interface 
device for a video game device, the real interface 
device manipulated by a player within a real space 
and represented by a virtual interface device within 
a virtual space, wherein: 
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light from the tight-emitting means is detected 
by at least a pair of light detection means dis- 
posed on the video game device; 
a position of the light-emitting means within the 
real space Is measured by measurement 
means disposed on the video game device 
based upon the light detected by the light de- 
tection means; 

the real position of the real interface device is 
converted into a virtual position within the virtu- 
al space by conversion means disposed on the 
video game device, the conversion means dis- 
playing the virtual interface device In the virtual 
position on a display; and 
movement of the virtual interface device Is dis- 
played on the display by an operating means 
disposed in the video game device, the operat- 
ing means causing a position detecting means 
disposed on the video game device to detect 
the real position of the real interface device and 
the conversion means to detemnlne the virtual 
position of the virtual interface device at prede- 
temiined time intervals AT,. 

13. A video game system that allows a player within a 
real space to play a video game within a virtual 
space, the video game system comprising: 
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a real interface device manipulated by the play- 
er within the real space; 
display means that displays a virtual Interface 
device within the virtual space that is a repre- 
sentation of the real interface device; 5 
position detecting means that detects a real po- 
sition of the real interface device within the real 
space; 

coordinate conversion means that converts the 
real position of the real interface device into a 
virtual position within the virtual space, and de- 
tennines a display position of the virtual Inter- 
face device on the display means based on the 
virtual position; and 

operating means that displays movement of the '5 
virtual interface device on the display means 
that corresponds to movement of the real inter- 
face device by the player, the operating means 
causing the position detection means to detect 
the real position of the real interface device and 20 
the coordinate conversion means to detennine 
the display position of the virtual interface de- 
vice at predetennined time intervals AT^. 
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